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Abstract 

Chung, Diaconis, and Graham considered random processes of the 
form Xn+i — anXn + bn (mod p) where p is odd, Xq = 0, a„ = 2 
always, and 6„ are i.i.d. for n = 0, 1, 2, . . .. In this paper, we show that if 
Pipn ~ —1) ~ P{bn = 0) = P{bn = 1) = 1/3, then there exists a constant 
c > 1 such that clogjP steps are not enough to make X„ get close to 
uniformly distributed on the integers mod p. 

1 Introduction 

In [2], Chung, Diaconis, and Graham considered random processes of the form 

Xn+i = 2Xn + bn (mod p) 

where = 0, &„ are i.i.d. for n = 0, 1, 2, . . ., and p is odd. They focussed 
on the case where P(6„ = 1) = = 0) P(6„ = -1) = 1/3. These 

random processes have some similarity to certain pseudorandom sequences used 
by computers. Subsequently some generalizations of this random process have 
been considered. See, for example, [1], [4], [5], and [6]. Suppose Pn{s) — P{Xn = 
s) where s G "L/plj. Define the variation distance of a probability P on Z/pZ 
from the uniform distribution U on li/pX by 

= ^ E \P{s)-l/p\^ u,^f\P{A)-U{A)\. 

I ^ — ' ACZ pi, 

sGZ/pZ 

They showed that for almost all odd p, ii N > j^^^^ + c, then \\Pn -U\\ = 
0((5/9)'^). They also state that more complicated arguments give the following 
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result: For any e > and almost all oddp, if > (c+e) logjp, then HP/y — < 
e where ^ 

c = ^1 - log2 ^^-ty^^ ^ = 1.01999186... 

Note that the values of Xn , when viewed as integers, range between —2^ + 1 
and 2^ — 1 , inclusive. Thus if A'^ < ( 1 — e) logj p where e > is given, the number 
of values in this range is at most 2p^^^ — l and ||PAr — [/|| > \ — {2p^~'^ — l)/p^ 1 
as p oo . 

Chung, Diaconis, and Graham [2] speculate, "It is conceivable that in fact 
(1 + o(l)) \0g2P steps are enough for almost all [odd] p to force Pjv to converge 
to uniform." However, we shall show that this statement, although described 
as conceivable in |2, in fact is false. In particular, we shall show the following 
theorem: 

Theorem 1 // P(6„ = 1) = P{h.n = 0) = P{h„ = -1) = 1/3 and X„ and 
are as above, then there exists a value ci > 1 such that if n — n{p) < cilog2P, 
then \\Pn ^ t^ll ^ 1 as p ^ 00. 

To motivate somewhat the proof of this theorem, we shall also prove the 
following theorem: 

Theorem 2 // P(6„ = 1) = 0.4, P(6„ = 0) 0.6, and X„ and P„ are as 
above, then there exists a value C2 > 1 such that if n — n{p) < C2\og2P, then 
\\Pn ^ U\\ ^ 1 as p ^ 00. 



2 Proof of Theorem [2] 

First observe the following proposition: 

Proposition 1 If Xq = and Xn^i = 2X„ + fo„ for n > 0, then 

X„ = ^2"-i-*6,. 

4=0 

Now suppose P(6„ = 1) = 0.4 and P(6„ = 0) = 0.6. Let A„ = |{m : < 
m < n — 1, 5m = 1}|. By elementary arguments, for any e > 0, P((0.4 — e)n < 
An < (0.4 + e)n) ^ 1 as n ^ oo. Thus, except on a set which has probability 
approaching as ri ^ cx), X„ takes on at most 

L(0.4+e)nJ 

E 

j=r(0.4-£)ril 

different values. We shall assume that 0.4 + e < 0.5. Note that Stirling's formula 
implies 

L(0.4+e)TiJ 

E 
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< (2en+l) 



n 

L(0.4 + e)n\ 



^ (2en + l)c3n"V2^ 



((0.4 + e)n)(0-4+«)"((0.6 - e)n)(O-6-O"27rv/((0.4 + e)n)((0.6 - e)n) 



^ C3(2e7i + l)V27m 1 



2^v/((0-4 + e)n)((0.6-e)n) (0.4 + e)("-4+^)»(0.6 - e)(o.6-.)« 
where C3 is a positive constant. Note that 

(0.4 + e)'^°-''+''"(0.6 - e)'"-''"''" = 2"((''-4+'^)'°S2(0-4+e)+(o.6-£)iog2(o.6~e))_ 

It can be shown that if < e < 0.1, then 

-((0.4 + e) log2(0.4 + e) + (0.6 - e) log2(0.6 - e)) < 1. 

If 

1 

C2 < 



-((0.4 + e) log2(0.4 + e) + (0.6 - e) log2(0.6 - e)) 
and n = n{p) < C2 log2P, then 

,pL(0.4+e)nJ /„N 

as p — > 00. Thus llPfi — C/|| —> 1 as p ^ 00 if ri = n(p) < C2 log2p. Note that C2 
can be chosen so that C2 > 1 since 

1 

> 1. 



-((0.4 + e) log2(0.4 + e) + (0.6 - e) log2(0.6 - e)) 



□ 



3 Overview of the Proof of Theorem [T] 

By Proposition [1] X„ is determined by the n-tuplc (&o, 61, . . . , f'n-i)- How- 
ever, if P{bn = 1) = P{bn = 0) = P{bn — —1), then many possible n-tuples 
(5o, 61, ... , 6„_i) may give the same value for X„. For example, if n = 3, the 
3-tuples (1,-1,-1), (0, 1,-1), and (0,0, 1) aU give X3 = 1. We shall place this 
n-tuple in a standard form (60, 61, ... , 6„-i) so that 

2"-i6o + 2"-26i + . . . + = 2"-i6o + a"-'^! + . . . + fe„_i. 

In this standard form, cither none of bo, 5i, . . ., are —1 or none of bo, 61, . . ., 
bn-i are 1. In the first case (excluding the event where bg, 61, ... , are all 
0), we shall show that for every e > 0, the number of values a in {1, . . . , n — 1} 
such that both ba-i and ba are 1 lies between (4/18 — e)n and (4/18 + e)n 
except for events which have probability approaching as n 00. Likewise, 
in the second case (excluding the event where 5o, 61, . . . , 6n-i are all 0), the 
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number of values a in {1, 2, . . . , n — 1} such that both fea-i and ha arc both 
— 1 Ues between ((4/18) — e)n and ((4/18) + e)n except for events which have 
probabiUty approaching as n — > oo. A Stirling's formula argument will give 
the theorem. 

We shall divide the n-tuples (6o,6i, . . . ,6„_i) into three cases. In the first 
case, there exists a value j in {0, 1, . . . , n — 1} such that bj = 1 and bk = 
if < fc < j. We call this case "first 1". In the second case, there exists a 
value j in {0, 1, . . . , n — 1} such that bj = —1 and 6^ = if < fc < j. We 
call this case "first —1". In the third case, bo = bi = . . . = bn-i = 0. As 
n — > oo, the probability of "first 1" approaches 1/2, and the probability of "first 
-l"approaches 1/2^ (Both probabilities are (1/2)(1 - [1/3)").) In "first 1", 
none of bo, bi, . . ., are —1. In "first —1", none of bo, b\, . . ., 6„_i are 1. 
We shall give detailed arguments for "first 1"; the arguments for "first — l"are 
similar. 

If we are in "first 1" , consider the infinite sequence (6o, bi, 62, • • •)• After some 

leading zeroes, with probability 1, this sequence consists of strings of "blocks" 
Bi,B2, ■ ■ ■ where Bi is a finite string starting with 1 and having no other I's 
in it. For example, if (60, b\, . . . , b\o) = (0, 0, 1, —1, 0, 1, 0, 1, —1, 1, 1), then there 
are two leading zeroes, Bi = (1, —1,0), B2 = (1, 0), B^ = (1, —1), and B4 = (1). 
Also we say that the first coordinate of Bi is 62 and that Bi has 62, 63, and 64 
as its coordinates. Note that the blocks Bi,B2, . ■ ■ are i.i.d. given that we are 
in "first 1" . 

Given an infinite series (60, 61, 62, . . .), technically the values bo,bi, . . . , bn-i 
may depend on n. For example, if (60,61,62) = (0,0,1), then (60,61,62) = 
(0, 0, 1) and 62 = 1 if n = 3. If (60, 61, . . . , 610) = (0, 0, 1,-1, 0, 1, 0, 1,-1, 1, 1), 
then (60, 61,..., 610) = (0,0,0,1,0,1,0,0,1,1,1) and 62 = if n = 11 even 
though 60, 61, and 62 are unchanged. Suppose a is such that Bi has 6a as one 
of its coordinates. Then for all n > a such that Bi does not also have 6„ as one 
its coordinates, (60, 61, ... , ha) will no longer vary with n. 

4 Number of a such that ha-i = 6a = 1 

We shall consider several distinct ways to get values a such that 6a- 1 = 6a = 1- 
These ways are detailed in the following lemmas. 

Lemma 1 Let iii be the number of a in {l,...,n — 1} such that ba-i = 1, 
ba = 1, 6a_i = 1, and ba = 1- Let e > 6e given. Given that we are in "first 
1", the probability that ((1/18) — e)n < ni < ((1/18) + e)n approaches 1 as 
n ^ oo. 

Lemma 2 Let n2 be the number of a in {1, ... ,n — 1} such that ba-i = 1, 
6a = 1; 6a_i = 1, and ba 1. Then = 0. 

Lemma 3 Let ns be the number of a in {1, . . . ,Ti — 1} such that ba—i — 1, 
6a = 1; 6o-i ^ 1, and ba = 1. Let e > be given. Given that we are in 'first 
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1 the probability that ((1/18) — e)n < < ((1/18) + e)n approaches 1 as 
n — > CXI. 

Lemma 4 Let be the number of a in {1, . . . , n — 1} such that ba-i = 1, 
ba — 1, ba-i ^ 1, and ha ^ 1. Let e > fee given. Given that we are in "first 
1", the probability that ((1/9) — e)n < < ((l/9) + e)n approaches 1 as n — > oo. 

Proof of Lemma\^ If we are not in "first 1", then ba is never 1. If we 
are in "first 1", then one obtains {bo, 5i, . . . , 6„_i) from {bo, bi, . . . , bn-i) as 
follows. If j is such that bj = 1 and 6^ = whenever < k < j, then 
bk = whenever < k < j. Otherwise, for each jo such that bj^ = 1, let 
ji ~ min(n, niin{^ : £ > jo,b£ ^ 1}). (By convention, assume that the minimum 
of an empty set is oo.) If fefc = for all k with jo < k < ji, then bj„ = 1 and 
bk = for all k with jo < k < ji. Otherwise bj^ = 0, and one can figure out the 
unique values for bk in {0, 1} when jo < k < ji. Lemma [2] follows. □ 

Proof of Lemma j^} To prove Lemma |4l let j be such that bj = 1 and 
bk = whenever < fc < j. Suppose that a — 1 > j and a < n. Then 
P(&a-i 7^ Ij^a 7^ 1) = 4/9. Suppose jo < a < ji with bj^ = 1 and ji = 
min(n,min{^ : £ > jo,be = 1}). Given jo and ji, there are 2^'^^^°^^ possibil- 
ities for (6jo+i, . . . , 6ji-i) and 2^^~^°~^ possibilities for (6j(,+i, . . . , &ji-i)- The 
possibilities for {bjg+i, . . . , 5jj_i), which range from (0, . . . , 0) to (—1, . . . , — 1), 
are in one-to-one correspondence with the possibilities for (6j„+i, . . . , 6jj_i), 
which range from (0, ...,0) to (1,...,1). Thus P{ba-i = l,ba = l\ba-i 7^ 

1,6a ^l) = 1/4, and P{ba-1 = l,&a = l,6a-l ^ l,ba ^ I) = 1/9. Lct 

Ca = {ba-1 = l,ba = L^a-i ^ l,ba ^ 1}. Conditioned on j such that bj = 1 
and bk — for < k < j, the events Ca for a— l>j,a<n, and a even are 
independent, and the events Ca for a—l>j,a<n, and a odd are independent. 
Since P(j > ein) ^ as n ^ oo (given that we are in "first 1") for each ei > 0, 
Lemma |4] follows by elementary arguments. □ 
Proof of Lemma{^ To prove this lemma, suppose that we are in "first l"and 
ba-i — 1 with a in {1, . . . , 71— 1}. Then ba-i — 1 and ba — 1 ii and only if 6^ = 1 
and bk — for all k with a < fc < ji where ji — min(n,min{£ > a : bi = 1}). 
Let us consider the infinite sequence {bo, bi, . . .). For positive integers i, let Di 
be the event that Bi = (1) and has no — I's in it. Note that P{Di) = 

(l/3)(X]i^i(l/3)') = 1/6. Observe that Di, D^, D5, etc. are independent 
and that D2, D4, Dq, etc. are independent. Furthermore, given ei > 0, with 
probability approaching 1 as n ^ 00, the number of a in {l,...,7i — 1} such 
that ba-i = 1 lies between ((1/3) — ei)n and ((1/3) + ei)n given that we are in 
"first 1". Suppose we are given e' > 0. Choose ei > so that ei < 6e'. Then 
with probability approaching 1 as n — > 00, at least ((1/18) — e')n events 
occur with i < ((1/3) — ei)n while at most ((1/18) -I- e')n events Di occur with 
* < ((1/3) + £i)n. Thus given e' > 0, the number of i such that Di occurs and 
the first coordinate of P^+i is bi for some £ < n is, with probability approaching 
1 as n ^ 00, between ((1/18) — e')n and ((1/18) -I- e')n. This number of i is 
within 1 of the number of a in Lemma [TJ the only possible difference occurs 
when the block Bi+i has fe„ as one of its coordinates. □ 
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Proof of Lemma\^ To prove this lemma, suppose we are in "first 1" , ha-i 7^ 
1, and ha = 1 with a in {1, . . . ,n ~ 1}. Then ba-i = 1 and 6a = 1 if and only 
if 6a- 1 = ^1 and 6^ = for all k with a < k < ji where ji = min(n, min{£ > 
a : bi = 1}). Let us consider the infinite sequence (60,61,...). For positive 
integers i, let Ei be the event that has no — I's in it and that Bi ends 

with —1. Note that P{Ei) = 1/6, that E'l, £"3, E^, . . . are independent, and that 
E2, E4, Eq, . . . are independent. Furthermore, given ei > 0, with probability 
approaching 1 as n — > cx3, the number of a in {l,...,n — 1} with 6a = 1 lies 
between ((1/3) — ei)n and ((1/3) + ei)n given that we are in "first 1". Thus 
given e' > 0, the number of i such that Ei occurs and the first coordinate of 
is b£ for some ^ < n is, with probability approaching 1 as n — > 00, between 
((1/18) — e')n and ((1/18) + e')n. This number of i is within 1 of the number 
of a in Lemma [S] the only possible difference occurs when B^+i has 6„ as one 
of its coordinates. □ 

In conclusion, the number of a in {1, ... ,71 — 1} such that 6a-i = 1 and 
6a = 1 (given that we are in "first 1" ) lies, with probability approaching 1 as 
n — > 00, between ((4/18) — e)n and ((4/18) + e)n for each e > 0. 

5 Stirling's Formula Argument 

If the number of a in {1, . . . ,n — 1} with 6a-i = 1 and 6a = 1 is no more than 
((4/18)+e)n, then either the number of odd a in {1, . . . , n— 1} with 6^-1 = 1 and 
6a = 1 is no more than ((2/18) + e/2)n or the number of even a in {1, . . . , n— 1} 
with ba-i = 1 and ba is no more than ((2/18) + e/2)n. 

Let us suppose that n is even and the number of odd a in {1, . . . , n — 1} with 
6a- 1 = 1 and 6a = 1 is no more than ((2/18) + e/2)n where e > is such that 
(2/18) + e/2 < 1/8. Then, the number of possible values of X;.r=o^ 2"-i-*6i if 
we have "first l"is at most 



where i?„ = {(4, ^2, ^3, 4) : h + £2 + h + h ^ (l/2)n,^i < ((2/18) + e/2)n}. 
The values £1, £2, £3, and £4 represent the number of odd a in {l,...,n — 1} 
such that 6a-i = 1 and 6a = 1, 6a-i = 1 and 6q = 0, 6a-i = and 6a = 1, and 
6a- 1 = and 6a = 0, respectively. 
For some polynomial pi{n) of n, 




((l/2)n)! 
£i!^2!4!4! 



(£i,£2A/4)ei?., 





+ - j n + 1 j 




< 



U^ + §)-J!(L(^-f)-J!)' 



< Piin) 
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= Pi 

But if 



(n)2(°-^'°S2(0-5)-((2/18)+e/2)log2((2/18)+e/2)-((7/18)-e/2) log2((7/54)-€/6))n 



Cl < 



0.51og,(0.5)-^log2(^)-^log2(^) 
where ci is constant and n = n{p) < ci logj p, then we can choose e > so that 

Pl(n)2(°-5'°S2(0-5)-((2/18)+£/2)log2((2/18)+£/2)-((7/18)-£/2)log2((7/54)-e/6))n 

P 

as p ^ oo . 

Thus for such values n, at most o{p) values of J27=o 2"~^~*&i occur in "first 
l"if n is even and the number of odd a in {1, . . . ,n — 1} with ba-i — 1 and 
6a = 1 is no more than ((2/18) + e/2)n. Minor adaptations of this argument 
apply if n is odd, we consider the number of even a instead of the number of 
odd a, or we consider "first — l"instead of "first 1". (For example, if n is odd 
but we still consider odd a in "first 1" , note that there are at most o{p) different 
values of X„-i and 3 different values of &„ to get that there are at most o{p) 
different values of X„ in this case.) There is only one value which is neither in 
"first l"nor in "first -1". 

Observe that 

^ 1.001525. 



0.51og2(0.5)- ^log2 (A) - ^log2 



Thus we may choose a value ci > 1 where if n = n{p) < ci \0g2P, X„ has, except 
for events with probability approaching as p ^ 00, at most o{p) values. Thus 
ll-Pn - ^ 1 asp^ 00. □ 



6 A Larger Value for ci 

A more careful analysis of the proofs of Lemmas [l] [3l and [4] shows that for 
each e > 0, the number of odd a in {1, . . . ,n — 1} with 6a-i = 1 and 6a = 1 
and the number of even a in {l,...,n — 1} with 6a- 1 = 1 and 6a = 1 both 
lie between ((2/18) — e)n and ((2/18) + e)n with probability approaching 1 as 
n — > 00 given that we are in "first 1". Since, given j, Ca are independent 
when a is odd, a — 1 > j, and a < n and Ca are independent when a is even, 
a — 1 > j, and a < n, the extension of Lemma U is straightforward. To see 
how to extend Lemma [1] consider the following argument. Let ik be the fc-th 
odd value of i such that Di occurs, and let be the value of a such that 
6a is the first coordinate of the block Bi+i^. Note that TO2 — mi, — m^, 
777.4 — W3, . . . are i.i.d. Let p be the probability that 7772 — 7771 is odd. If 7771 is 
even, then the sequence 7771,7772,7^3, . . . consists of ri consecutive even values, 
then r2 consecutive odd values, then consecutive even values, etc. where 
''ij ^2, ?'3, • ■ ■ are i.i.d. geometric random variables with parameter p. If r77i is 
odd, then the sequence 7771,7712,7(7,3,... consists of ri consecutive odd values, 
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6a-l = 0, 


6a-l = 0, 


6a-l = 1, 


6a-l = 1, 






6a =0 


6a = 1 


6a = 1 


6a = 


ba- 


-1 = 1, 6a = 1 








1/18 


1/18 


ba- 


-l^l,ba^l 


1/9 


1/9 


1/9 


1/9 


ba- 


-1 - 0, 6, = 1 


1/18 


1/18 








ba- 


-1 = -1, ba = 1 








1/18 


1/18 


ba- 


-1 = 1, 6a =0 





1/18 





1/18 


ba- 


_1 = 1, 6, = -1 


1/18 


1/18 









Table 1: Cases for ba-i, ba, ba-i, and b, 



then r2 consecutive even values, then consecutive odd values, etc. where 
'ri,r2,r3, . . . are i.i.d. geometric random variables with parameter p. Note that 
for each e > 0, by Kolmogorov's maximal inequality (see p. 61 of Durrett [3], 
for example), max(|ri - r2|, |(ri - + (r3 - r4)|, . . . , |(ri - + (7-3 - r^) + 
. . . + (r„_i — r„)|) < en for even n with probability approaching 1 as n ^ 00. 
Since for some positive constant c, max(ri, r2, . . . , r„) < cln(n) with probability 
approaching 1 as n ^ 00, this result and a similar result involving Di when i 
is even imply that, for each e > 0, the number of odd a in {1, . . . , n — 1} so 
that ba-1 = 1, 6q = 1, ba-1 = 1, and ba — I minus the number of even a in 
{1, . . . ,n — 1} with ba-1 = ^, ba — 1, ba-i = 1, and 6a = 1 has absolute value 
less than en with probability approaching 1 as n ^ 00 given that we are in "first 
1". Thus given e > 0, the number of such odd a lies between ((1/36) — e)n and 
((1/36) + e)n with probability approaching 1 as n — > c» given that we are in 
"first 1". A similar argument applies for Lemma [31 

With arguments resembling the proofs of Lemmas [1] [2l [Sj and [H one can 
show 



Lemma 5 Given that we are in "first 1", the number of a in {1, 
such that ba-1 = 1 (md ba = lies, for each e > 0, between ((5/18) 
((5/18) + e)n with probability approaching 1 as n — s- 00. 

Lemma 6 Given that we are in "first 1", the number of a in {1, 
such that ba-1 = and ba — lies, for each e > 0, between ((4/18) 
((4/18) + e)n with probability approaching 1 as n —-^ 00. 

Lemma 7 Given that we are in "first 1", the number of a in {1, 
such that ba-1 = and ba — 1 lies, for each e > 0, between ((5/18) 
((5/18) + e)n with probability approaching 1 as n — > 00. 

While the details are not shown here. Table [6] outlines the arguments to be 
shown. For example, the entry 1/18 for 6a-i = 1, 6a = —1, 6a-i = 0, and 
6a = means that the number of a in {1, . . . , n — 1} with 6a_i = 1, ba = — 1, 
6a-i = 0, and 6a = lies, given e > 0, between ((1/18) — e)n and ((1/18) + e)n 
with probability approaching 1 as n — > 00 given that we are in "first 1" . 



...,n- 1} 

— e)n and 

...,n- 1} 

— e)n and 

...,n- 1} 

— e)n and 
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More careful arguments (similar to the extensions of Lemmas [1] [31 and [1]) 
show that the number of odd a in {1, . . . ,n — 1} with ba-i = 1 and ba = 
lies between ((5/36) — e)n and ((5/36) + e)n (given e > 0) with probability 
approaching 1 as n ^ oo given that we are in "first 1" . Similar statements hold 
for even a here; similar statements (where 2/18 replaces 4/18 and 5/36 replaces 
5/18) also hold for odd a and even a in Lemmas H] and [71 

The total number of possible values of J27=o 2"~^~*6i (except for events 
with probability approaching as n oo) in "first l"is at most (for even n) 



E 



with Sn = {(^1, ^2, 4, h) : £i+£2+e3+h ^ (l/2)n, ((4/36) - e)n < ^ < 
((4/36) + e)n, ((5/36) - e)n < I2 < ((5/36) + e)n, ((5/36) - e)ri < 4 < ((5/36) + 
e)n, ((4/36) - e)n < £4 < ((4/36) + e)n}. 

A Stirling's formula argument shows that if 

1 

Ci < 



0.51og2(0.5)-^log2(^)-^log2(i) 
and n — n{p) < ci logjp where ci is a constant, then 



(^l/2/3/4)eS„ 



in 



is o(p). For odd n or "first —1", similar arguments can be used. Thus if 
n = n(p) < cilog2P, Xn has o{p) possible different values except for events 
with probability approaching as p — > 00. Thus ||P„ — U\\ —>■ 1 as p — > 00. 
Note that 

^ : 1.00448. 



0.51og2(0.5)-^log2(^)_^log,(^ 



Thus there is a gap between this lower bound and the best upper bound claimed 
in Chung, Diaconis, and Graham [2]. Exploring this gap is a potential problem 
for further study. 
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